web crawler
noun
,
Digital Technology
1.
a computer program that automatically retrieves Web pages for use by search engines.
Compare
bot
3
.
Also,
Web crawler,
webcrawler
.
Also called
spider
.